Video In Sentences Out

نویسندگان

  • Andrei Barbu
  • Alexander Bridge
  • Zachary Burchill
  • Dan Coroian
  • Sven J. Dickinson
  • Sanja Fidler
  • Aaron Michaux
  • Sam Mussman
  • Siddharth Narayanaswamy
  • Dhaval Salvi
  • Lara Schmidt
  • Jiangnan Shangguan
  • Jeffrey Mark Siskind
  • Jarrell W. Waggoner
  • Song Wang
  • Jinlian Wei
  • Yifan Yin
  • Zhiqi Zhang
چکیده

We present a system that produces sentential descriptions of video: who did what to whom, and where and how they did it. Action class is rendered as a verb, participant objects as noun phrases, properties of those objects as adjectival modifiers in those noun phrases, spatial relations between those participants as prepositional phrases, and characteristics of the event as prepositional-phrase adjuncts and adverbial modifiers. Extracting the information needed to render these linguistic entities requires an approach to event recognition that recovers object tracks, the track-to-role assignments, and changing body posture.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Compositional Framework for Grounding Language Inference, Generation, and Acquisition in Video

We present an approach to simultaneously reasoning about a video clip and an entire natural-language sentence. The compositional nature of language is exploited to construct models which represent the meanings of entire sentences composed out of the meanings of the words in those sentences mediated by a grammar that encodes the predicate-argument relations. We demonstrate that these models fait...

متن کامل

Grounded Language Learning from Video Described with Sentences

We present a method that learns representations for word meanings from short video clips paired with sentences. Unlike prior work on learning language from symbolic input, our input consists of video of people interacting with multiple complex objects in outdoor environments. Unlike prior computer-vision approaches that learn from videos with verb labels or images with noun labels, our labels a...

متن کامل

Content Analysis Table of Medical Ethics Book Based on Allport’s Theory of Value System

Introduction: Regular assessment of academic textbooks and revision of teaching methods are critical for making such textbooks more efficient in meeting the needs of the new generation and conveying values to them. Therefore, in line with the necessity of textbook evaluation, this research examined the extent to which the Medical Ethics book named “physicians and ethical considerations” observe...

متن کامل

overview of ways to enhance the security of video surveillance networks using blockchain

In recent decades, video surveillance systems have an increasing development that are used to prevent crime and manage facilities with rapid diffusion of  (CCTV)cameras to prevent crime and manage facilities. The video stored in the video surveillance system should be managed comfortably, but sometimes the movies are leaking out to unauthorized people or by unauthorized people, thus violating i...

متن کامل

Establishment an international prison in order to Execution of criminal sentences of the International Criminal Court

However, the punishment of imprisonment has become the main response of domestic and international arsenals; But now one of the most important challenges facing the International Criminal Court is how to enforce its sentences, and especially the execution of imprisonment.according to the Statute of the Court, imprisonment is carried out through voluntary agreements with the receiving countries ...

متن کامل

Fire detection using video sequences in urban out-door environment

Nowadays automated early warning systems are essential in human life. One of these systems is fire detection which plays an important role in surveillance and security systems because the fire can spread quickly and cause great damage to an area. Traditional fire detection methods usually are based on smoke and temperature detectors (sensors). These methods cannot work properly in large space a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012